Papers with dynamic sampling strategy
Dynamic Sampling Strategies for Multi-Task Reading Comprehension (2020.acl-main)
Copied to clipboard
| Challenge: | Prior work focused on model architecture or generalization to held out datasets and largely passed over the particulars of the multi-task learning set up. |
| Approach: | They propose a dynamic sampling strategy that selects instances proportional to the model's current performance on a dataset relative to its single task performance. |
| Outcome: | The proposed model outperforms the best model on ORB, a recent multitask reading comprehension benchmark. |
Making Pre-trained Language Models Better Learn Few-Shot Spoken Language Understanding in More Practical Scenarios (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing few-shot Spoken Language Understanding models need to be trained on a set of data-rich source domains and adapt to the target domain with a few examples. |
| Approach: | They propose a scenario where only a pre-trained language model and a few labeled examples are used to train few-shot SLU models. |
| Outcome: | The proposed model outperforms existing models on few-shot settings by reducing the number of slot labels and reducing training complexity. |
Exploration-Exploitation Reshaping towards Efficient Reasoning for Large Language Models (2026.findings-acl)
Copied to clipboard
Yufeng Shi, Weilin Luo, Yuxiang Zhang, Zongmeng Zhang, Haoyang Liu, Yubing Wang, Bin Wang, Wengang Zhou, Houqiang Li
| Challenge: | Large Reasoning Models (LRMs) are constrained by the overthinking issue. |
| Approach: | They propose a policy optimization framework that reshapes the exploration and exploitation through two core components: self-imitation and self-guidance exploration. |
| Outcome: | The proposed model achieves superior reasoning efficiency without compromising overall accuracy. |